18.05 Lecture 9 
February 23, 2005 



Discrete Random Variable: - defined by probability function (p.f.) 
{s 1 ,s 2 ,...}J(s i )=¥(X = s i ) 

Continuous: probability distribution function (p.d.f.) - also called density function. 
f(x) > 0, X!° TO f(x)dx, F(X eA) = f A f(x)dx ' 

Cumulative distribution function (c.d.f): 

F(x) = F(X < x),x e M 
Properties: 

1. X! < x 2 ,{X < Xl ] C {X < x 2 } 

— > P(X < Xi) < P(X < x 2 ) non-decreasing function. 

2. lim^-oo F(x) = ¥(X < -co) = O.lim^oo F{x) = ¥(X < oo) = 1. 

A random variable only takes real numbers, asi^ — oo, set becomes empty. 

Example: ¥(X = 0) = \,¥{X = 1) = ± 

F(x) 

l-l • 
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P(X < x < 0) = 

P(X < 0) = ¥(X = 0) = \, F(X <x)= F(X = 0) = l,xe [0, 1) 
¥(X < x) =F(X = or 1) = l,x e [l,oo) 

3. "right continuous": lim y ^ a .+ = F(x) 

= P(X < y), event {X < y} 



X 



f) < Vn} = {X< x}, F(y n ) -> P(X < x) = 

71=1 

Probability of random variable occuring within interval: 

¥{ Xl < X < x 2 ) = F({X < x 2 }\{X < Xl }) 
= F(X < x 2 ) - F(X < x x ) 
= F(x 2 )-F( Xl ) 
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{X < x 2 } D {X < xi} 



Probability of a point x, V(X — x) 

= F(x) - F(x~) where F(x~) = lim x ^ x - F(x), F(x+) = lim x ^ x+ F(x) 
If continuous, probability at a point is equal to 0, unless there is a jump, 
where the probability is the value of the jump. 

P(zi < X < x 2 ) = F(x 2 ) - F(x-) 
F(A) = P(X e A) 

X - random variable with distribution F 
When observing a c.d.f: 



Discrete: sum of probabilities at all the jumps = 1. Graph is horizontal in between 
the jumps, meaning that probability = in those intervals. 




"1 point mass 
J exists at jump 
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when flat c.d.f 
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Continuous: F(x) = P(X < x) = f*^ f(x)dx 



eventually, the graph approaches 1. 
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If f continuous, f(x) = F'(x) 

Quantile: p e [0, 1], p-quantilc = inf{x : F(x) = F(X < x) > p} 

find the smallest point such that the probability up to the point is at least p. 

The area underneath F(x) up to this point x is equal to p. 

If the 0.25 quantile is at x = 0, F(X < 0) > 0.25 
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Note that if disjoint, the 0.25 quantile is at x = 0, 
but so is the 0.3, 0.4. ..all the way up to 0.5. 

What if you have 2 random variables? multiple? 

ex. take a person, measure weight and height. Separate behavior tells you nothing 
about the pairing, need to describe the joint distribution. 
Consider a pair of random variables (X, Y) 
Joint distribution of (X, Y): ¥((X,Y) E A) 
Event, set A e R 2 
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Discrete distribution: {(s{, si), (si, s|), ...} 3 (X,Y) 
Joint pi.: f(s},s?)=F((X,Y) = (s},sl)) 
= F(X = s},Y = s*) 

Often visualized as a table, assign probability for each point: 
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Continuous: 



f(x,y)>0, f(x,y)dxdy = / f(x,y)dxdy = l 

Jm 2 J-oc J -co 

Joint p.d.f. f(x,y) : ¥{{X,Y) € A) = j A f(x,y)dxdy 
Joint c.d.f. F(x, y) = F(X < x,Y < v) 




If you want the c.d.f. only for x, 
F(x) = F(X <x)= P(X < x, Y < +oo) 
= F(x, oo) = lim^oo F(x, y) 
Same for y. 

To find the probability within a rectangle on the (x, y) plane: 
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(subtracted twice) I 



Continuous: F(x,y) = J*^ f(x,y)dxdy. Also, §^ = f(x,y) 
** End of Lecture 9 
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